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Software Disclaimer 


This program is free software; you can redistribute it and/or modify it under the terms of the 
GNU General Public License as published by the Free Software Foundation; either version 2 
of the License, or (at your option) any later version. This program is distributed in the hope 
that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of 
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public 
License for more details. You should have received a copy of the GNU General Public License 
along with this program; if not, write to the Free Software Foundation, Inc., 675 Mass Ave, 
Cambridge, MA 02139, USA. 
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1. Project description 


GPdotNET is artificial intelligence tool for applying Genetic Programming and Genetic 
Algorithm in modeling, prediction and optimization of engineering problems, as well as set 
of linear programming based problems e.g. traveling salesman problem, assignment and 
transportation problems. The GPdotNET is built on top of .NET and Mono frameworks written 
in C£ programming language which can run both on Windows, Linux based OS, or any OS 
which supports Mono framework. The Project started in 2006 within postgraduate study of 
modeling and optimization with evolutionary algorithms. As open source project, the 
GPdotNET is first published on November 5, 2009 on gpdotnet.codeplex.com. 


GPdotNET is very easy to use and handling with it. Even if you have no deep knowledge of 
GP and GA, you can apply those methods in finding solution. The project can be used in 
modeling any kind of engineering process, which can be described with discrete data, as well 
as in education during teaching students about evolutionary methods, mainly GP and GA. 
The project is licensed under GNU Library General Public License (LGPL). 


For information about license and other kind of copyright please see 
http: dotnet.codeplex.com/license. 
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Figure1.1: GPdotNET v3 Start Screen 
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The GPdotNET project is hosted at http://godotnet.codeplex.com for Windows users, as 
well as http://code.goosgle.com/p/gpdotnet for Linux users. 


Main place for all news, documentation and code changes is the blog site 
at http: / /bhrnjica.net/gpdotnet. 


Note: If you have never heard about GP and GA, recommendation for getting basic information about GP 


is http;//en.wikipedia.org/wiki/Genetic programming. The wiki page also contains some links to other web sites 


about GP For GA there is wiki page which contains a basic information about GA at this 


link http://en.wikipedia.org/wiki/Genetic algorithm. 


GPdotNET supports the following types of use case scenarios: 


Ί. 


Model for Discrete Data — modeling with/or without prediction of discrete data by 
using Symbolic Regression modeling with GP 

Model & Opt. for Discrete Data - modeling with/or without prediction of discrete 
data by using Symbolic Regression (SR) with GP and Optimizing calculated 
GPdotNET model by using GA, 

Model for Time Series - Time Series modeling and prediction data by using SR 
with GB. 

Optimization of Analytic Function - optimization of analytic defined 
function by using GA, 

TSP — solver for Traveling Salesman Problem (TSP) by using GA, 


Assignment Problem - solver for Assignment Problem (AP) by using GA, 


Transportation problem - solver for Transportation Problem (TP) by using GA. 


Listed GPModel types are shown on the Figure 1.2. To create new GPModel you can click on 
"New" button located in application bar. If you want to open existing one, you can choose 
"Open" button. Among New and Open options GPdotNET contains more than 10 created 
samples which describe every supported type in GPdotNET. To open one of those models 
click the hyperlink from the starting panel. 
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Figure 1.2: GPdotNET "New Dialog" options in GPdotNET 
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2. Introduction to GPdotNET 


This User Guide is related to GPdotNET version 3.0, the latest release which brings set of new 
solvers in linear programming. With previously 4 models, and new 3 models, with GPdotNET 
you can create 7 different GPModels, from modelling, optimization, time series modelling, 
and optimization of analytic function, TSP, AP and TP. This is huge step forward in comparing 
to previous version. 


In the following text, it is listed the main features in GPdotNET grouped by version 1, 2 and 
3. 


Cross OS and Cross platform software (new in v2) 


One of the main requirements for GPdotNET is ability to run on multiple OSs, by using .NET 
and Mono Framework. So GPdotNET can run on all OS where Mono is implemented. During 
the implementation every piece of code is tested against Mono. During implementation, 
when code was not compatible with Mono, it was replaced with the code implementation 
compatible with Mono. It can be said that the whole implementation was done using Visual 
Studio and Mono Develop, working on Windows and Fedora 17. didn't have much time to 
test GPdotNET on OS other that Windows 7 and Fedora 17, so every bug report would be 
appreciated. 
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Figure 2.1: GPdotNET in MAC OS environment. 
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Figure 2.2: GPdotNET in Fedora 17 OS environment 


New text based file format *.gpa (new in v2) 


GPdotNET V1.0 supported binary file format, and for large population size the file size was 
also big. On the other hand, with text file format there is a possibility to modify file outside 
the GPdotNET. For example you can see whole population chromosomes, and see other data 
you are interesting in. You can also perform some manual modification if you like by 
modifying training or testing data as well as parameters. In general, manual modification file 
is not recommended. 


Support for Excel and CSV export (new in v2) 


Exporting in GPdotNET is based on open XML file format, but there are some compatibility 
issues in Mono. In fact you cannot use Excel exporting in Mono. While you running 
GPdotNET on Mono you can export data in CSV file format, and Wolfram Mathematica. This 
is only one feature which is not running in both Mono and .NET. 


Optimization of GPModels (new in v2) 


GPdotNET can run optimization of calculated GPModel. Optimization is very important for 
any engineering system. You can perform optimization after you perform modeling and get 
the parameters which your model is optimal. In fact you can run optimization and modeling 
as much as you want with only one constrains: "You cannot run Optimization and Modeling 
at the same time". 
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Optimization of analytically defined function (new in v2) 


GPdotNET now supports optimization of any analytically defined function. You can define 
function in "Tree Expression Designer" - TED, define constrains and perform optimization. 


Traveling Salesman Problem (TSP) (new in v3) 


The solver in GPdotNET version 3 contains set of solvers based on linear programming. TSP 
problem represents common problem in LP, and GPdotNET supports this kind of problem in 
unlimited number of cities. Unlimited number of cities can be defined in GA, because of 
nature how GA is searching for solution. 


Assignment problem (AP) (new in v3) 


Assignment problem present generalized TSP problem. Similar as previous it is implemented 
with vector based chromosome type. 


Transportation problem (TP) (new in v3) 


The most complex implementation in GPdotNET is transportation problem which required 
matrix based chromosome. With this implementation GPdotNET can search for solution to 
almost any LP problem. 


Support *.csv data file 


GPdotNET support csv file format for loading training, testing and time series data. Common 
example of data file can be seen on the following picture. 


Regardless of user localization floating numbers must be written with decimal point. On this 
way we skip some complexity and localization issue seen in the previous version. 

Columns are separated by semicolon, and rows with newline. The last column is always 
output variable. In case of Time Series, data file can contains only one column. 


13007152 .4712771016.8171422.4 
150052457.27225.47:1358.05;3048 
1250;152.47;25.4;901.88;1270 
LO007609.6725.471171.5674140.2 
13007152 ..4712771053.3571422.4 
T307304.67 76.271278.6172590.6 
15007609 .67127 71767 .3672794 
12507609.6776.27:2196.57;2768.6 


Figure 2.3: Sample of csv file 
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Info tab in Model (new in v2) 


When new GPdotNET model is created a new Info Tab is created as well. Info tab contains 
rich edit control in which you can paste or load any rich text content from text to picture. On 
this way, you can attach textual information of you model. 
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Figure 2.4: Info Tab in GPdotNET 


New Look& Feel (new win V2) 


Unlike previous version, GPdotNET has new simplified GUI with only one application bar 
containing all available options. Commands are split in to 4 major groups: Model, Modeling, 
Export and Common. It is very simple and gives you all options directly on the screen. Run, 
Stop and Optimize commands are shifted to main toolbar, in order to give usability to stop 
or run programs from any tab page, not only from run page. 
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Figure 2.5: Grouped Options in GPdotNET 


3.1. Working with GPdotNET 


Picture below shows typical Start Screen of GPdotNET. Start screen can be divided in to 
several meaningful parts in order for better understanding UX of the GPdotNET. 


(1) Title bar 


(2) Application bar 
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Main parts of the Starts Screen are: 
1. Title Bar 
2. Application Bar 
3. Start Page 
4. Status Bar 
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3.1. Title Bar 


Title bar contains Icon, application name and system options on the right side. With system 
options you can Close, Maximize and Minimize application. In fact this is standard windows 
system options. 





3.2. Application Bar 
E | | 
η "De ϱ ο ὁ 55ο s 
Mew Üpen Save Close Run Stop Üptimize Model Test Info Exit 
GP Model GP Modelling Export GP result Common 


Main Toolbar — exposes main commands in GPdotNET. The commands are grouped in to 4 
major groups. 


1. GPModel - gathers commands for manipulation of GPdotNET model file. There are 
options for Create, Open, Save and Save as GPdotNET model file, as well as Close 
currently opened model. Those commands are self-explained. 


2. GP Modeling contains three commands for Run, Stop and Optimize GPModels. 
Commands are enabled or disabled automatically, whenever there is a possibility user 
can achieve logic action. For example while GP is running, user cannot press Run 
button, because there is no sense to press this button. In case Stop button is enabled. 
Optimize button is available when GPModel is ready for optimization. 


3. Export GP Result contains options for exporting result to other format: Excel, CSV and 
Mathematica. 


4. Common group contains option for common usage: Info to show basic information 
and Copyright of the application, and Exit option to close the application. 
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3.3. GPdotNET Start Page 


ΒΒ .... 
e om. 


Links 
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Figure 3.2: Start Page in GPdotNET 


If you are new to GPdotNET, there is no better starting point that Start Page. With Start Page 
you can try one of the predefined and recalculated samples. In fact Start Page contains all 
information you need to begin using GPdotNET. From recalculated samples to links for 
documentation all information about GPdotNET can be found here. Start Page contains 
Samples which are split in 6 major groups (see Fig. above). 


1. Modeling & predictions 
Modeling & Optimization 
TSP Solver 

Time Series Modeling 

AP Solver 

TP Solver 


o Uu KR W Inm 


Note: This version doesn't support persisting Optimization of analytic function, so there are 
no samples for it. 


The last group of links is links for documentation and User Guide. 
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4. Working with Modelling and Prediction 


Start working with GPdotNET can be as simply as clicking any of the predefined use case 
sample. If you click on Simple Case link from Start Page. After some time GPdotNET Model 
is loaded similar picture shows below. 


Load Data | Functions | Settings | Run Result | Info 

Y 
0,367924841 
0,301250784 
0,246667457 
0,201984357 
0,165408343 
0135471672 
0,110973109 
0,020920725 
0,07453 7462 
0,061138883 
0,050196803 
0041272765 
0,034009468 
0,028116475 
0,023358602 
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1 
2 
3 
4 
5 
6 
7 
8 
9 





Training Data.. 
Prediction Data... 


Figure 4.1: Load Data Table page in GPdotNET 


There are several tab controls which separate information about model. GPdotNET shows 
several tabs when you load sample from Modeling and Prediction. The same set of tab 
controls GPdotNET load when you select New, and choose the first option for Modeling. 


4.1. Load Data Tab 


4.1.1 Loading Discrete Data 


The Load Data tab control (see Fig. 10) appears in every type of modeling. This is one of the 
main tabs. For every GPModel you need a data, to train your model. When you want to 
model common discrete data, Load Data Tab contains two buttons. 


1. Button for loading training Data — with training data your GP model will be trained. 


2. Button for loading testing data — with testing data your model will be tested, after 
model is calculated. 


Note: You don't need to load testing data in order to make a GPdotNET model. Training data 
is used when you want to test calculated model. 
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Load Data | Functions | Settings | Run 


j 


1 
2 
3 
4 
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6 
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Result 


Info 


γ 
0,36792484] 
0,301250784 
0,246667457 
0,201984357 
0,165408343 
0,135471672 
0,110973109 
0,090929725 
0,07453 7462 
0,061138883 
0,050196803 
0,041272765 


0,034000468 


0,028116475 


0,023358602 


4.1.2 Loading Time Series Data 





Training Data.. 


Prediction Data... 


Figure 4.2: Load Data Table page in GPdotNET 


With GPdotNET you can perform modeling with Time Series data as well. Run GPdotNET and 
click on MSFT Stock Quote. You opened Times series model. You can recognize that Load 
data is different than previous (see fig.) 





Load Data | Functions | Settings | Run 
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Figure 4.3: GPdotNET Load Data tab in case of Time Series Modeling 
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Bottom part of Tab page, you can set number of variables to be as input variables, as well as 
if you want to define testing data to test calculated model. After you defined variables and 
Test data, in order to run, you need to press "Set to GP" button, that GPdotNET create 
training and testing data. 


4.2. Function Tab 


Function tab contains all available function in GPdotNET. Function defined here will defined 
function set, from which model is constructed. 


There are two important columns which you can modify. Selected and Weight columns. 
When you want that certain function will be included in Function Set you need to check it. 
Weight column describe selection probability. From the picture above, + function has 
Weight=4, that means it has 3 times greater probability to be chosen, than subtraction 
function which has weightz 1. On this way we can influence on probability of certain function 
in Function Set. 


4.2.1. Changing Weight of the function 

If you want to change weight of certain function do the following: 
1. Click on certain function 
2. Enter new weight value in text box on right side 


3. Press button Update row. 


Load Data | Functions | Settings | Run Result | Info 


Weight Name Definition Aritry — P.. Description ExcelDefinition 
xl«-x2 Addition xl«x2 Weight: 
x1-x2 Substraction x1-x2 
xl*x2 Multiplication x1*x2 Update row 


[] 
[] 
[] 
[] 
[] 
[] 
[] 
[] 
[] 
[] 
[] 
[] 
[] 
[] 
[] 
[] 
Γη 


κ. κὸ 
xl-x2-x3 
x1-x2-x3 
x1*x2*x3 
xl/x2/x3 
xl-x2-x3-x4 
x1-x2-xi-x4 
xl*x2*xi*x4 
xl/x2/x3/x4 
x1^2 

x1^3 

x1^4 

x1^5 

x1^1/3 
x1^1/4 
x1^1/5 

Ixi 


alf 


Division 

Addition with with 3 arguments 
Substraction with 3 arguments 
Multiplication with 3 arguments 
Division with 3 arguments 
Addition with with 4 arguments 
Substraction with 4 arguments 
Multiplication with 4 arguments 
Division with 4 arguments 

x to the power of 2 

x to the power of 3 

x to the power of 4 

x to the power of 5 

Cube root 

Quartic root 

Quintic root 

Inverse 

Ahenhute walia nf w 
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IF(ISNUMBER([... 


xl-x2-x3 
x1-x2-x3 
x1^x2*x3 


IF(ISNUMBER([... 


xl-x2--x3-xd 
x1-x2-x3i-x4 
x1l"x2*x3*x4 


IF(ISNUMBER(... 


power(x1;2) 
power(x1;3) 
power(x1;4) 
power(x1;5) 
power(x1;1/3) 


IF(ISNUMBER(... 


POWER(x1:1/'5) 
IF(x120:0:1/x1) 
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Figure 4.4: GPdotNET Function Tab 
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4.3. Settings Tab 


With Settings tab you can define parameters of genetic programming. GP parameters are 


Self-explained. If you don't know how to setup parameter, just live default values. It is suitable 
for most of problems. 


Load Data | Functions Settings | Run Result Info 


Population Max Tree depth Type of procesors 
- 200 (50-5000) Initialize depth: 5 (3-17) i 
() Single core 
Fitness; RMSE-Root mean square error 7 
Initialization: HalfHalfinitialization : Solo 
Selection Random constants 
Elitism: 1 (0-PopSize) 
From: 0 
Method: FitnessProportionateSelection τ 
To: 19 


Probability of gp operations 


Crossover: 0,9 (0,0 -1,00) 
Mutation: 0,05 (0,0 -1,00) 
Reproduction: 0,2 (0,0 -0,50) 


Figure 4.5: Settings Tab in GPdotNET 


Settings tab also contains option to enable parallel processing of some certain GP 


calculation. So if your PC has more than one processor you can enable this kind of 
processing. 
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4.4. Run Tab 


With Run Tab you control of GP modelling simulation, as well as defining Termination criteria 
of GP run. Rub Tab contains two Chart controls for simulation Fitness values, and GP Model 
during evolution of the program. 


η.  ὁ Ον: 


Open Save Save As Close Run Stop Optimize 
GP Model GP Modelling Export GP result 


Load Data | Functions | Settings Run Result | Info 


Evolution 
Envolve until: 


Generation number 

Generation: 

Best fitness: 

Max fitness: 

Changed at generation: 29 


Run started at: 13.9.2012 13:44:40 


"P 
E: 
z 

3 

5 
^l 
(5 


Cur. iteration (sec): 0,02 
Avg. finish time: —| 19.3.2012 13:44:50 
Avg. time left (min): 0,16 
Duration(min): 0,018 





Status: Ready! 


Figure 4.6: GPdotNET v2 Run Page 


By using GP Modeling controls from the application toolbar you can control simulation and 
program running. In general there are 3 way to define termination criteria. 


1. Number of evolution — when you chose the Generation number from the Combo Box 
2. Fitness Exceed Value — when you choose Fitness >=from Combo Box. 


3. If you click on Stop toolbar button during program execution 


4.5. Setting Termination Criteria 


Termination criteria can be set, when you choose one of the two predefined option in Combo 
Box. After you choose Combo Box option, you have to specify value in edit box. 


You can change termination criteria whenever you want except during the program 
execution while the controls are disabled for editing. 


17 


GPdotNET v3.0 User Guide 


4.6. Result Tab 


Result tab show current best solution GPdotNET calculated. The main space of Result tab 
occupy Tree Draw expression which show best solution in expression tree. Below tree 
expression you can find solution in analytical form. 


Load Data | Functions | Settings Run 
Random Constants: GPModel (Tree form) 





Name Value 
3,8374... 











GPModel(Simple text) 
(((X2*R6)/(X1«R3))/((X2*X2)*X2)) 


Status: Ready! 





Figure 4.7: GPdotNET v2 Result Tab 


Expression tree can also be saved in png image format. 
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4.7. Prediction Tab 


Perdition Tab is shown when you load Testing Data. In any other case Prediction Tab will not 
be shown in GPdotNET environment. Picture 9 shows Prediction Tab, which contains Table 
and Chart of predicted data calculated with the current solution. 


"eoHhHeeoddo: 


Open Save Save As Close Run Stop Optimize 
GP Model GP Modelling 


Load Data | Functions | Settings | Run 


X4 
883,3 i 1457,78772 -11,58 
1110,07 879, 2643,37104 -763,77 
1056,26 77 1204,66314 573,331 
1463,67 | 411197767 -13179 
1255,47 i 1457,78065 675,81: 
1637,69 ; 2743,3171 -228,71 
1472,73 22, 2780,85388 24174€ 
1786,69 2590, 3174,26831 -583,4 


Won 14 d FAAA SETT 4700 na id 
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GP Model Prediction 


GPdotNET 


Status Ready! 





Figure 4.8: GPdotNET Perdition Tab 
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4.8. Info Tab 


Info Tab is useful when you want to attach some information about problem you want to 
solve with GPdotNET. Info Tab contains Rich Edit control which you can load any rtf file 
format. By choosing "Load RTF" button command, you can load rtf file from disk. 
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Figure 4.9: GPdotNET Info Tab 
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5. Working with Optimization 


When you choose new use case called Modeling& Optimization additional tab will be 
shown called Optimization, in comparison of Modelling/Prediction. 


Optimization is always performed after you got a good GP model. After GP Modeling is 
finished, you have to set boundaries of input variables, set termination criteria (similar as in 
previous Run Tab), and check Minimum check box if you want to find minimum value of the 
model. Unchecked means you are finding Maximum value. 


5.1. How to Set Min/Max value of Variables 


1. Select variable form bottom grid in Optimize Model Tab, by clicking left mouse 
button. 


2. In Min and Max text box input values 
3. Press Update button. 


4. Select another variable and perform previous steps. 


"eo Beéeoddg:t: © 


Open Save Save As Close Run Stop Optimize Model 
GP Model GP Modelling Export GP result 


Load Data | Functions | Settings | Run Optimize Model | Result 


Evolution GP Fitness Simulation 
Envolve until: L] Minimum Tage 


Generation number * |500 
Generation: 31 


Best fitness: 


Changed at generation: 26 
Run started at |19.9.2012 14:07:39 


Cur. iteration (sec): 0,08 


I. 
LL] 
= 
Ὁ 
o 
0. 
O 


Min Value Max Value Optimum 
0.25 0.38 27,2062 
Avg. time left (min): 0,625 7 16 15,94089 


Avg. finish time: 19.9.2012 14:08:17 


Duration(min): 


Status: Ready! 





Figure 5.1: GPdotNET Optimize Model Tab 
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6. GPdotNET Optimization of analytic function 


The main new feature among several other is Optimization based on Genetic Algorithm. You 
can either optimize GPModel calculated previously by using GP modeling, or also optimize 
analytically defined function defined with analytic function editor. The picture below shows 
sample of defining f(x) x?- 6x? + 4x + 12 in the analytic function editor. During 
construction of the function, right table is filled automatically with variables and constants. 
End of process of defining analytic function is finished when the Finish button is pressed to 
transfer variables and constants in to Optimization panel. 


TX GPdothET v2.0 


| αἱ ET CN a a 
se HEC Os > 
New Open Seve Save As Run | Optimize Model 
GP Model Export GP result 





Test 
































w 


GPdot NET 














Analytic function definition tool 
Functions: - ; | Adel Fun || Finish 


"Param name must be in form of XL. X2, ... or Xn, where n in natural number. 





Figure 6.1: Analytic function editor in GPdotNET 


After the Finish button is pressed, switch to Optimize model tab and define maximum and 
minimum values for input variables. The remaining process is the same as we have seen in 
previous chapter. 


6.1. Working with Analytic function definition tool 


In addition with GPdotNET it will be possible to find global maximum or minimum of the 
function defined in analytic term as well. The picture below shows analytic tool definition. 
You can also see a brand new GUI for the GPdotNET v2.0. 
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Within Group Box (see Fig. 12) you can see several buttons and combo box for selection 
basic math function. For example if you select SIN function from the combo box and click 
on Add function button, in the central window two rectangles will appear similar like this: 


The picture represents sin function with one argument. O argument means that it is not 
defined yet, and you will not go further until you specified the name of the argument, or 
define another function in chain. The tool automatically knows how many arguments need 
every defined function in GPdotNET. 


If you select + or * function you will get three node, one with function name and two for 
arguments. Similar like this picture: ES 


6.1.1. Defining function arguments 


Every function must define its argument in order to works correctly. Letter small o in the 
second rectangle means that the argument of function sin is not defined yet. To define 
argument select node with left mouse click, enter the name of the argument, and click on 
Add Param button. Whole process is depicted on picture below. 





Analitic function definition tool 


Functians: - 





Param name 





Figure 6.2: Adding function argument 
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6.1.2. Deleting the nodes in function 


With Delete button you can delete nodes. In fact you can delete only leaf node. If you have 
bunch of nodes, and want to delete node in the middle, you need to delete all leaf node 
below it, in order to delete it. So select the leaf node with mouse and click on Delete node 
button. 


After you finish the function definition, you must be sure that you defined all function nodes 
correctly with proper number of argument, otherwise GPdotNET will analyses it and cannot 
pass further until you correct the function argument issue. 


6.1.3. How to optimize analytic function in GPdotNET 


This is short tutorial how to use GPdotNET in order to find global optimum of analytically 
defined function. 


Let's take an example of not so simple function. The picture below shows graph of the 
function. The function has two local minimum in interval from -5 to 5. 





Figure 6.3: Graph of polinomal function 


(x+4)(x+1)(x-1)(x-3) 
14 


Analytic term of the function is: y = + 0.5. 


To be sure that we are dealing with correct result, first find optimum from Wolfram Alpha. 
The picture below shows global optimum of our function. 
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" | W. | ; ... η μη atin 
$é WolframAlpha' e225. — 


| minimum 0.5+((x+4)(xt1)(x-1)(x-3))/14 








— gn — Ks) --ΕΕ — F Examples S Random — 


Input interpretation: 


1 
minimize 0.5 + T ((x + 4)1(x + 1) f(x — 11 (x — 31) 


Global minimum: More digits 


min{0.5 4 = (x-4(x-l)jx-1l)(x- 3)! + —2.9377 at x « —2.93536 


Plat: 


(x from —4 to 4) 





Computed by Wolfram Mathematica (X) Download page 


Figure 6.4: Wolfram Alpha info abut function minimum of the function 


From the above we see that global minimum can be found for X=-2.93536, and 
corresponded optimal value is y=-2,377. 


So let's try to find this optimum with GPdotNET v2. 
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(gb GPdotNET v2.0 - [newModel] = oH 
dne: Save Close > Stop Optim 3 Info Exit 
> Model GP Modelling Common 





GP Model creation wizard! 


Ci Model for Discrete Data 
(1 Model & Opt. for Discrete Data 
(3 Model for Time Series 





. GPdotNET v2 User Guide 


Status: Ready! 


1. Open the GPdotNET and choose New. 

2. Select Optimization of Analytic Function radio box 
3. Click OK button. 
4 


Optimization module appears on the screen. 


Stop Optimize 
GP Modelling 


Analytic function 


Analytic function definition tool 


C NE, 
e Ó—— | 


*Param name must be in farm of X1, X2, ... or Xn, where n in natural number. 
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Now we need to define function in analytic form. As we have previously seen in blog post: 
1. Select" +" function from Function combo box and press Add Function button. 

Click on left outer node 

Select "/" function and press Add Function button. 

Select left outer node 

Select Mul4 function and press Add Function button. 


For each outer node of Mult4 function add + function, similar like previous. 


Dt Gn d e de» αν 


For each left outer node of + function, add Param Name X1 and press Add Param 
button. 


8. For right node add 4, 1,-1,-3 param from left to right. 
9. For right node of Mul4 function add 14 param. 
10. For right node of / function add 0, 5 param. 

After you finish you get the following picture: 


η ene o9. QQ - 


Üpen Save Stop Üptimize Model 
GP Model GP Modelling Export GP result 


Analytic function | Settings | Optimize Model 


Analytic function definition tool 


Functions: - Add fun Finish 


Param name*: 05 Delete node 


*Param name must be in form of X1, X2, ... or Xn, where n in natural number. 





11. Press Finish button and select Optimize Tab page. 


12. Select X1 variable in List View control for defining variable range 
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13. Enter -10 for min and 15 for maximum and press update button. 
14. Select Minimize check box, for minimum. 
15. Now we can perform optimization by press Optimize toolbar icon. 


16. After very short period of time you get the following picture which 


“Ωω 


Run 
Analytic function | Settings Optimize Model 


Model 
Export GP result 


e B 


Üpen Save 
GP Model 


Mew 


Stop 
GP Modelling 


Optimize 


Evolution 
Envolve until: Minimum 


| Generation number 500 


300 


Generation: 


Optimal Value: 


Changed at generation: 
Run started at: 
Cur. iteration (sec): 
Avg. finish time: 
Avg. time left (min): 


Duration(min): 


381 


6.10.2012 10:25:51 
Min Value Max Value 


-10 15 


Optimum 


NIME -2,93539 


ΧΙ 
5.10.2012 10:25:51 
0 


0,082 





Status: Ready! 


From picture above we can see that we got Xmin=-2,935 and Ymin=-2,9377, exactly as we got 
when we have performed optimization by Wolfram Alpha. 
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7. Solving TSP problem with GPdotNET 


7.1. TSPChromosome class implementation 


Instead of binary value, TSP chromosome must be array of integers by representing path 
around cities. The main problem with this chromosome type is genetic operations, because 
you cannot implement it easily. 


For example standard Crossover in GA takes random point and split parents in two parts, see 
picture below. One part goes to first offspring, the second one goes to second offspring. The 
same action is performed for the second parent. The picture below shows standard crossover 
in GA. 


CROSSOVER POINT 


P1 
p 


O1 
02 





Unfortunately this operation cannot be applied to TSP, because every city can be visited only 
once. But how can we perform crossover at all? There are several methods can be found on 
internet. The method applied in GPdotNET is the following. 


Choose different random points for Parent 1 and Parent 2. 

Offspring 1 is created based on the left part of Parent 1, and sub permutation of the rest of 
Cities. 

Offspring 2 is created based on the right part of Parent 2 and sub permutation of rest of the 
Cities. 

Picture below show crossover used in GPdotNET. 
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CROSSOVER POINT FOR P1 








P1 
P2 
CROSSOVER POINT FOR P2 
RANDOM SUBPERMUTATION 
O1 
O2 
RANDOM SUBPERMUTATION 


The problem with this crossover is that offspring are not created based on genetic material 
from both parents. 


7.2. Loading City Map 


TSP Solver needs City data of points in (X; Y) format. It must be loaded by CSV file format, 
the same as GPdotNET uses for loading data for modelling and optimization. The following 
data represent correct format: 


CityMap data format: 
" 
File Edit Search View Encoding Language Settings Macro Run Plugins Window 7 

she Ὠ απ“ 4 ΕΓ»! αν xiu m2 s Πε | m m fel ub we 

] 0:13 

0:26 

0:27 

0:35 

2:0 

5:13 

5;19 

5:25 

5731 

















10:10 
11710 
12:10 
1115 
15:13 
15:13 
1525 
15:31 - 


Active Server Pages script file length: 892 lines; 132 Ln:58 Col:6 Sel;0|0 Dos\Windows | AMSIasUTF-8 INS 
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7.3. How to run TSP Solver on GPdotNET 


Running TSP solver with GPdotNET is relatively easy. The procedure follows global 
convention for creating new model or solver. 


1. Choose New from Application Bar. 


ge GPdotNET v2.1 -- - 
P ΠῚ a 3 
enne ὁ ο ϐ ts * ^ e 
New Open Save Close Run Stop Optimize Model Test Info Exit 
GP Model GP Modelling Export GP result Comman 
Ed Avaliable GP models in GPdotNET 





e Ops | GPdotNET Model creation wizard! 
| 


Madeling&P GP Models 





Model tor Discsete Dara el Traveling zaleasman Problem 
m Simple Cage 
7 } Weld Hardee Model & Opt for Discrete Date 
Re { Surface Roug Model for Time Senes 


Opteron of Analytic Funcban 


Cancel OK 


Status Ready 


2. Choose Traveling Salesman Problem, and click OK button. 
3. Open Load Data tab, (if it not opened), press Load Cities Map button, 
chooseCityMap.CSV, and press OK. Data is presented on picture below. 


e GPdotNET v2.1 - TSP Problem Salver -cESM 
=" | 3 5 = 58 [- | 
e B Ee o OQ *- * ^ a 
New Open Save Chose Run Stop Optimize Model Test info Exit 
GP Model GP Modelling Export GP result Common 


Load Data Settings | Simulation 


Pos X Y ^ 
C 152 19 
(2 115 ΤΤΒ 
(1 17 12 
(C4 317 ESI] 
(5 553 161 
(6 390 135 

lur δ (7 T5 237 

7 CB 920 Bl 

ES co 280 928 

CIO 241 550 
cn 161 ΤΙ 
cw 082 932 
Ci 506 285 
cia 481 743 
C15 gai 284 
(18 312 553 
CU H 431 7 


| tet eMe | 


Status: Ready! 


4. Set GA parameters on Setting Tab panel: 
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må GPdotNET v2.1 - TSP Problem Solver 











Status Ready! 








5. Open Simulation Tab panel. You can see graphically representation of loaded map, 


and set νυ 
a GPdotNET v2.1 - TSP Problem Solver - ΗΕ 




















6. Press Run Application button, and Solver will start. During simulation you can see 


that the path length is becoming shorter and shorter 
7. As final result, Solver fined the path which is the shortest or very close to shorter 


one. 
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gà GPdotNET v2.1 - TSP Problem Solver 


η e Ὁ ΦΟ 0 


New Open Save Clase Run Stop Optimize 


GP Model GP Modelling 


Load Data Settings Simulation 


Evolution 
Envolwe until: 
Generation number = 5000 
Generatian: 842 
Shorter Path found 31,268,074 


Changed at generationc 605 
11.2.2013 18224:16 


Gv ET 
κ. ον -[ο 


Run started at: 
Cur iteration geg: 202 
Avg. finish twee: — 112.2013 18:25:19 
Avg. time left (min); 1,04 
Duration(min): — 0,219 


zz 
κ. 3 
Lx 
um 
Le 
Let 
Lu 
La. 
in 
um 
ux f 
a 


- c NI 


n a 
Info Exit 
Common 





Progress... Shortest path; |Cl-C3-C7-C20-C17-C4-C10-CT16-C11-C2-C9-C 18-C14-C19-C 12-C 15-C8-Cb- C 1340501 





Status: Ready! 


8. Exit and Save your solution. 


We have seen how easy to implement such a problem based on existing foundation of the 


GPdotNET. 
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8. Solving Assignment Problems (AP) in GPdotNET 


8.1. Introduction to AP 


AP deal with the question how to assign n objects to m other objects in the best possible 
way. Best possible way can be represent optimal (with minimum or maximum) value of the 
objective function. Most of the APs have m» n which means that assignment operation deals 
with not equaly numbers of objects. All such a problems can be transformed to mzn, by 
adding fake assignment operations. 


Ona example of AP can be formulate as follow: Suppose that a taxi firm has three taxis (the 
agents) available, and three customers (the tasks) wishing to be picked up as soon as possible. 
The firm prides itself on speedy pickups, so for each taxi the "cost" of picking up a particular 
customer will depend on the time taken for the taxi to reach the pickup point. The solution to 
the assignment problem will be whichever combination of taxis and customers results in the 
least total cost. 


However, the assignment problem can be made rather more flexible than it first appears. In 
the above example, suppose that there are four taxis available, but still only three customers. 
Then a fourth dummy task can be invented, perhaps called "sitting still doing nothing", with a 
cost of 0 for the taxi assigned to it. The assignment problem can then be solved in the usual 
way and still give the best solution to the problem. 


Similar tricks can be played in order to allow more tasks than agents, tasks to which multiple 
agents must be assigned (for instance, a group of more customers than will fit in one taxi), or 
maximizing profit rather than minimizing cost. 


The formal definition of the assignment problem (or linear assignment problem) is 


Given two sets, A and T, of equal size, together with a weight function C: A x T > R. Find a 
bijection f: A — T such that the cost function: 


>, Ca fa) 

acA 

is minimized. 

Usually the weight function is viewed as a square real-valued matrix C, so that the cost 
function is written down as: 


Subject to the constants 
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2 xj — l,fori€A 
JET 


2 xj =1,forj ET 
LEA 


xj; 20,fori,j ΕΑ,Τ 


The variable xj; represents the assignment of agent ito taskj, taking value 1 if the 
assignment is done and 0 otherwise. This formulation allows also fractional variable values, 
but there is always an optimal solution where the variables take integer values. This is 
because the constraint matrix is totally unimodular. The first constraint requires that every 
agent is assigned to exactly one task, and the second constraint requires that every task Is 
assigned exactly one agent. 


8.2 AP in GPdotNET 


Solving AP with GPdotNET begins by clicking “New” button from Application Bar, and 
selecting AP Solver from New GPModel dialog (see pic. below). 





g GPdotNET v3.0 
. | 1 a 3 
μφῷὸο Ὁ Ὁ o a 
New Üpen Save Close Run Stop Optimize Model Test Info Exit 


GP Model GP Modelling Export GP result Common 


Links 


ΒΗ en. 
e omen 


GPdotNET Model creation wizard! 


(3 Model for Discrete Data te C Traveling Salesman Problem 
m ΐ Modeling&Predictions (2 Model ἃ Opt. for Discrete Data 
z j (3 Model for Time Series 
li Simple Case (C) Optimization of Analytic Function 


Weld Hardness 


Surface Roughness predictions 





Assignment problems Transportation problems 


Figure 8.1: Creating new AP Model in GPdotNET 
After clicking OK button, GPdotNET shows several tab pages similar on the following picture. 
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New Open Save Close > . Optimize 
GP Model GP Modelling 


Load Data Settings | Simulation | Info 




















Figure 8.1 Load Data Tab in when modeing AP in GPdotNET 
The first step in defining AP in GPdotNET is loading data of the problem. 


8.2.1 Preparing and loading data in AP 


As we can see from introduction data for AP problem must be in matrix form, so the following 
picture can represent proper format of AP data. 


MAS Ione a eens 


!4 cars 

IW Fl F2 F3 F4 
2767707347 3450 
28;M;36;34;0 
ZU ον ο ο 1 ΤΙ 
ο ο μὲ ο SUD 
ARE SIS SÅS SØE EA] 
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In GPdotNET v3 and late you can put comments in data file. The picture above contains three 
lines of comments which will not be loaded. Then we have 5 lines represent rows in AP. 
Columns are divided by semicolon. From the picture above it can be seen “M” letter in the 
middle of the data. "M" represent maximum number (infinity number). Other symbol which 
can be seen in data is "L" which represents the minimum value (negative infinity). Decision 
when to put M or L letter depends of the solution. 


1. If we want to find minimum cost of AP and want to put fake row in order to 
define closed solution, we can put M letter. 

2. If we want to find maximum cost of AP and want to put fake row in order to 
define closed solution, we can put L letter. 


Stop Optimize 
GP Modelling 


"27090600 


GP 


Load Data Settings | Simulation | Info 





B 
28 
M 
28 
32 
30 














Status: Ready! 


Figure 8.2: Loaded data in AP model 


8.3. Running AP problem with GPdotNET 


When the data is loaded we can start by defining GP parameters and start with finding 
solution. The process is identical like other, so this step we will not be describe. After we start 
finding solution by clicking START button, we can see that GPdotNET find solution very 
quickly. The picture below show solution for problem we have described above. 
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Run Stop Optimize 
GP Modelling 


EIKKI: 


Evolution 
Envolve until: Minimum 


Generation number » |500 
Generation: 500 
Optimal Solution 110 


Changed at generation: 3 
Run started at: 29.10.2013 8:07:38 
Cur. iteration (sec); 0.01 
Avg. finish time: 28.10.2013 8:07:38 
Avg. time left (min): 0 
Duration(min): 0,04 


DE l l lű ο Á—— I — £7 
Status: Ready! 





Figure 8.3: Empty TP Model in GPdotNET 


As we can see from the picture above, result is shown as array of number. Actually, result is 
presented as vector, which position of number represent column, and the value represent 
the row of started problem. From the picture above result is [2 5 1 4 3] which means the 
following results: 





ο locations 


'4 cars 

IW F1 F2 F3 F4 
ie τα απ αι 
D8[; M; 36;34;0 
20;28;30;28,0 | 
30;32;36;B0]0 
2s 307-3272: 


Vector number represent the row index, and position means column index. 
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9. Solving Transportation problems in GPdotNET 


Solving TP with GPdotNET begins by clicking "New" button from Application Bar, and 
selecting TP Solver from New GPModel dialog (see pic. below). 


οὐ 
Üpen Save Close Run Stop Optimize Model Test Info Exit 


GP Model GP Modelling Export GP result Common 


πως 
e ο... 


GPdotNET v3.0 





Links 


GPdotNET Model creation wizard! 


5 

Lu! Modeling&Predictions (3 Model ἃ Opt. for Discrete Dig 

£ j (O Model for Time Series 
BNG Simple Case (C) Optimization of Analytic Function 


Weld Hardness 


Surface Roughness ictions 





Assignment problems Transportation problems 


Figure 9.1: Creating new TP Model in GPdotNET 


The process of defining TP model is like previous one. So first step is define training data. 
Training data can be presented as table of values imilar like picture shows below. 





14 locations 


I4 cars 

IW Fl F2 F3 F4 
POE DES SÅ El 
284M;36;34;0 
νε. 
ΙΕ, ΠΠ 
ο ο τα 


The AP problem can contains different number of cols and rows, which leads to define 
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additional col or rows in order to define layout GPdotNET expects. With the same procedure 
we can define fake col or rows n AP to define compatible problem GPdotNET supports. 
The symbols M and L represent plus infinity or minus infinity the same s in AP. 


The Settings Tab page is the same as in previous problems so no need to additional 
information. 

Simulation tab simulate problem searching and shows result. Unlike from AP problem here 
we have result in Matrix form. 


ιο ος :^: o su 


Open Save Run Stop Model Info 


GP Model GP Modelling Export GP result Common 





| Load Data | Settings | Simulation | Info 


Evolution GP Fitness Simulation 
Envolve until: 


Generation number 











Generation: 
Optimal Solution 


Changed at generation: 


Avg. time left (min): 
Duration(min): |0. 

















Status: Ready! 


Figure 9.2: Result preentatiom in Simulstion Tab Page 


The result represent the optimal transportation solution. 
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10. GPdotNET File format 


GPdotNET v2.0 introduce new textual file format for persisting GP and GA models and 
information during the program run. The file format is simple and easy, so sometimes you 
can edit in order to correct some minor changes. For example if you create GPModel without 
optimization, but later on you need to optimize this mode, you can easily change the type 
of model to enable optimization. The picture below shows sample GPdotNET "gpa" file 
format opened in Notepad++ with syntax highlighting. 


πο ο - Notepads « 
Ee Edt Search View Encoding Language Settings Macro Run P 
σ 20 Ὦ ου οί « ο ο σα αι & + 


!GPdotNET v2.0 File format 
' 
tiine 1: GP Model 1- symbolic regression: 2 -symbolic zegression with optimisation, 3 - time series, 4- analytic oprimisati 
1 
tiine 2 Training Data 
0.,712441161;0.52386208074;0.549752454;0.5907$2436:; 0.663060956:;0.475729624;0.461024912;0.52067453; 0.059461156:0,9017761059 ; 
{1156 3 Testing Data 
tiine 4 TimeSeries Data 
flane 5: GP PArameters is sorted in the following order 
\popSize: Fitness; initialization: InitDepth rOperationDept ;Elitiem:Sel Method;Paraml;Param2;Const From;COnst To;Con COut:CrossO 
500:0:72:7715:170:07:070:;10:6:0.9;0.05:0.2;0.05;0.970;:0: 
tiine 6;- Selected Function 
172171;0:07:0:0707171:0:071:07:07070:07070:07070:07070707070;0:070:0:07171;71;:170:;0:0:0:0;0? 
tiine 7 Type of Running program 0- means generation number, 1 - fitness value : 

e.g. 1:700 - run program until max fitness is greate ar equel than 700 

0;500 - run program for J00 evolutions 


'Line 9 Pepuletics: sisesbest fitness: bestchromoscretree 
500 7959.36: 20001001 200920062000 700T1IOOS 200 T20UOS20091003 
frise 9 τὸ Line 9^pop3Jize represent chromosomes 15 pepclatica 
731.12;2008200820061000 
731.12;200620032005200220051007200*5100020012003200610042004100610021005:100120071008200581000200420081002200581003200810072002 1 
731.12;200920071003 
.12:20082002200620081000200820062008200220082001100310072008200310013100110071002 
731.127;20062004200720071006200720C071000200320031006100210071002200510012007100820041001100710001006200220021003100220061004 
,12:2006200020091005200010021002 
7200720051002 
:200820086200820032002100010032008200010061005 


Ln:12 Cols? Sel: 





Figure 10.1: GPdotNET file format highlighted in Notepad ++ 
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11. Exporting Results in GPdotNET 


11.1. Exporting to Excel and 


When the model is calculated, you can export training and testing data in to Excel (only for 
Windows user) and csv file format. 


When you export to Excel you can export GPModel in form of Excel formula, for further 
analysis. 


Choose model icon if you want for export training data and GPModel. Otherwise choose 
Test icon for exporting testing data. 


After you choose right export icon, export dialog appears: 


GP Model Export wizard! 


Select file format: 





Fiqure1 1.1: Export dialog 


After you select right export format, ”Save dialog” appears, to choosing right file name and 
path. 


In case of Excel exporting GP Model column is as text showing formula. You need to put 
equal sigh in front of content in order that model be calculated. The picture below show 
similar case. 


The reason why you need to put = sign is that sometime formula is too long, and cannot be 
pasted in to cell. 
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d WH 9” ers asdfsadfd1.xlsx - Microsoft Excel Preview ? & - D x 
HOME INSERT PAGE LAYOUT FORMULAS DATA REVIEW VIEW LOAD TEST TEAM Bahrudin Hrnjica 7 5 
π % Calibri -In τ kr amm ΞΗ D- = General . Ez Conditional Formatting 7 En Insert * > v oY d 
Fr TTT E [ΖΡ Format as Table ~ &* Delete ~ - 
PME Ν BIU-|H- 2 DAC ΞΞΤΕΤἘ 7 = 36 * “od 3 [5 Cell Styles + fe] Format fr iin iig 
Clipboard rz Font F Alignment Ta Number Ta Styles Cells Editing ^ 
| 13 - | : | p | 1 | 
B ς D E F G H I J K L M N [e] P [a] 
1 DATA 
2 |X1 X2 X3 x4 Χ5 Χ6 Χ7 x8 x9 X10 Υ Ygp 
4 | 2 3 4 5 6 7 8 9 10 11 12 
3 | 3 4 2 6 z 8 9 10 11 12 13 
6 | 4 5 6 7 8 9 10 11 12 13 14 
7 | ^ 6 7 8 9 10 11 12 13 14 15 
8 | 6 7 8 9 10 11 12 13 14 15 16 | 
9 | 7 8 9 10 11 12 13 14 15 16 17 HF 
10 | 8 9 10 11 12 13 14 15 16 17 18 
11| 9 10 11 12 13 14 15 16 17 18 19 
12 10 11 12 13 14 15 16 17 18 19 20 
13 11 12 13 14 15 16 17 18 19 20 21 
14 12 13 14 15 16 17 18 19 20 21 22 
15 13 14 15 16 17 18 19 20 21 22 23 
16 14 15 16 17 18 19 20 21 22 23 24 
17 15 16 17 18 19 20 21 22 23 24 25 
18 16 17 18 19 20 21 22 23 24 25 26 
19 17 18 19 20 21 22 23 24 25 26 27 
20 18 19 20 21 22 23 24 25 26 27 28 
21 | 19 20 21 22 23 24 25 26 27 28 29 | 
22) 20 21 22! _ 23 24 25 26 27 28. 29. 30. | | | | οι” 
TRAINING DATA (Ὁ : [ | [>] 











Figure 11.2:: Excel showing GPModel as excel formula. You need to type = in order to evaluate right formula. 
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11.2. Export GPdotNET Model in to Mathematica 


Suppose we have calculated the model and want to export it to Mathematica, see picture below. 


se Hh @6OoO 


New Run Optimize 


GP Model GP ass 


Load Data | Functions | Settings | Run Result | Info 
Random Constants: GPModel (Tree form) 





Name Value 

R1 -0,834... 
R2 0,2578... 
R3 -0,638... 
R4 0,2593... 
R5 -0,833... 











((((R1^3)-(R1^2)) ^4)^5) (K((XT- RT) + ((R4-R4)+(R5+X1+R5))  (XT-R2))-((R3-XT) -R3))-(X1^2))*((((R5-« XT -« (R5*X1)) * R5) ^4)*(R5* (RA ^3) ^ 3)))) « (((UXT- (R5 RT R2)) « (RA* (R4 R2- R3)))  (((R3 ^4)*R2)* (R2 « R5) ^4) - R4 (R2 X1 X1))))-(((R2^3)-(X1* 
(R3“5)))*2)+((R5+R5)-((R4-(R1*3))+R4)))))+(((((R1+R1) ^4) ^4) ^1/3) X1 ((XT-RT) - (IRA « (R5- (RT RT&RT))) R2)  (RT^4)^1/3) « (RT*((RS «XT RT) ^2) ^1/3)))) 





Status: Ready! 


The bottom text box from the picture above shows GP model in analytic form. This is pretty much 
terms and operations. Actually the analytic term of GP Model will be converted in to Mathematica 
syntax, and exported to txt file. On this way you can copy exported text and paste to Mathematica. 


From the Export GP Result group controls choose GP Model button, select Mathematica, click OK, 
name the txt file and press OK button. All operations are showed on picture below. 
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Now we have Training data set and GP model in Mathematica language, so we can copy them and 
paste in to Mathematica notebook. 


Open saved txt file and you will see something similar showed on the picture below. 


η" data = ((20, 206.55}, (10, 197.04), (0, 159.03}, (-10, 124.5}, (-20, 78.51), (-30, 66.25), (-40, 45.39}}; 


siie gpmodel = 


( (Power [ (Power [ ( (Power {[ {(- 0. 834890007972717), 3]) - (Power[ (-0.834890007972717), 2}}}, 4]}, 51) + 
{{{{{({Χ1 + (-0.834890007972717)) + ((0.259310007095337 - 0. 259310007095337) + ((-0.833019971847534) + X1 + (-0.833019971847534))) + (X1 - 0.25780001282692) ) - (((-0.638610005378723) - X1) + (-0.638610005378723))) - (Power[X1, 2])) « 
((Fower[(((-0.833019971847534) + X1 + ((-0.833019971847534) « X1)) + (-0.833019971847534)), 4]) « ((-0.833019971847534) ə (Power [ (Power[0.259310007095337, 3]), 3})))) + 


((((X1 - ((-0.833019971847534) + (-0.834890007972717) + 0.25780001282692) ) + (0. 259310007095337 ə (0 . 2593100070953337 + 0.25780001282692 + (-0.638610005378723)))) + 
(((Power[(-0.638610005378723) , 4]) 0.25780001282692) » { (Power [ (0.25780001282692 + (-0.833019971847534)) , 41) + 0.259310007095337 + (0.25780001282692 + X1 + X1)))) - 


( (Power [ ( (Power [0 . 25780001282692, 3]) - (Xie (Power [ (-0. 638610005378723), 51))), 2]) + (((-0.833019971847534) + (-0.833019971847534)) - ((0.259310007095337 - (Power [ {- 0. 834890007972717), 3])) + 0.259310007095337))))) + 
( (Power [ (Power [ (Power [ ( {(-0. 834890007972717) + (-0.834890007972717)), 4]), 41), 1/37) +X1 + 
(COG = (=0.834890007972717)) + ((0.259310007095337 + ((-0.833019971847534) - { {(-0. 834890007972717) + (-0.834890007972717) + (-0.834890007972717)))) + 0.25780001262692} ) + 
( (Power [ (Power[(-0.834890007972717), 41), 1/3)) + ({-0. 834890007972717) « (Power [{ (Power [ {(-0. 833019971847534) + X1 + (-0.834890007972717)), 21}, 1/3))))))): 


The file contain two things: 


e Training data model represented as Mathematica list collection, and 
e GP Model translated in to Mathematica notation. 


Copy the first group of text and paste it to Mathematica notebook, then copy the second text group 
and paste to Mathematica below the first one. The flowing picture shows training data set and GP 
model in Mathematica. 


E 


data-((20,206.55), (10,197.04), (0,159.03), (-10,124.5), (-20,78.51), (-30,66.25), (-40,45.39)); 


gpmodel-( (Power [ (Power[ ( (Power[ (-@.834890007972717) ,3]) -(Power[ ( -0.834890007972717) ,2])) ,4]),5]) *((((((X1«(-0.834890007972717) )+( (0. 259310007095337- 
0.259310007095337)«((-0.833019971847534)4X1«(-0.833019971847534) ) )+(X1-@.25780001282692) ) -(((-0.638610005378723) -X1)«( -0 . 638610005378723) ) ) -(Pouer[X1,2]) ) *( (Power[ ( ((- 
0.833019971847534)4X1«((-0.833019971847534)*X1) )« ( -0. 833019971847534) ) ,4]) *((-0.833019971847534) * (Power [ (Power [0. 259310007095337,3]),3])) )) «((((X1-((- 
0.833019971847534)«(-0.834890007972717)40.25780001282692) )+(@.259310007095337* (0.25931000709533740.257800012826924 ( -0.638610005378723)) ) )+( ( (Power [ (- 


0.638610005378723) ,4])*0.25780001282692) * ( (Power [ (0. 25780001282692+( -0 . 833019971847534) ) ,4])40.2593100070953374(0.257800012826924X14X1) ) ) ) - ( (Power [ ( (Power 
[0.25780001282692,3]) -(X1* (Power[ (-@.638610005378723) ,5]))),2])+(((-@.833019971847534)+(-@.833019971847534) ) -((0.259310007095337- (Power [ ( - 

0.834890007972717) ,3]) )40.259310007095337) ) )) )+( (Power [ (Power[ (Power[ (( -0.834890007972717)4(-0.834890007972717) ) ,4]),4]) ,1/3])+X1+(((X1-(- 

0.834890007972717) )+((@.259310007095337+( (-@.833019971847534) - ((-0.834890007972717)4 ( -Ə . 834890007972717 )+( -0 . 834890007972717) ) ) )40.25780001282692) ) « ( (Power [ (Power[ ( - 
0.834890007972717) ,4]) ,1/3])«((-0.834890007972717) * (Power[ (Power [ ( (-0.833019971847534)4X1«(-0.834890007972717)) ,2]),1/3])))))); 





Now that we have GP model in Mathematica, we can do lot of things. 


Simplifying GP analytic model: By typing Simplify[gpmodel], Mathematica will try to simplify your 
model as simple as possible. 
Look what happens when we execute Simplify[gpmodel] against the model we are currently dealing: 


In4js- Simplify [gpmodel] 


oujg- -0.83489 (-192.345 +1. ((-1.66791 + x1)?)'? 


- 3.69145 X1 + 0.0134025 X1? + 0.0000264049 X1? - 3.11866 x 105 X1* + 1.8056 x 10" X1? - 4.11204 x 10? x1*) 


This is awesome, and nobody can simplify such a complex term better than Mathematica. 


45 


GPdotNET v3.0 User Guide 


If your model contains 3 or less independent variables you can plot it. For example execute this 
command: 


funpl = Plot[{gpmodel}, (X1, -40, 20}, PlotRange -> {1-45, 251, 135, 2201], Frame -> True , 
PlotLegends -> Placed[{"GP Model"}, Above]] 


The picture below shows the result from the command above: 


—— GP Model 
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That was just a few options you can execute against GP model when you export it to Mathematica. 
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